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Abstract 

User scheduling and multiuser multi-antenna (MU-MIMO) transmission are at the core of high- 
rate data-oriented downlink schemes of the next-generation of cellular systems (e.g., LTE- Advanced). 
Scheduling selects groups of users according to their channels vector directions and SINR levels. 
However, when scheduhng is applied independently in each cell, the inter-cell interference (ICI) power 
at each user receiver is not known in advance since it changes at each new scheduling slot depending 
on the scheduling decisions of all interfering base stations. In order to cope with this uncertainty, we 
consider the joint operation of scheduling, MU-MIMO beamforming and Automatic Repeat reQuest 
(ARQ). We develop a game-theoretic framework for this problem and build on stochastic optimization 
techniques in order to find optimal scheduling and ARQ schemes. Particularizing our framework to the 
case of "outage service rates", we obtain a scheme based on adaptive variable-rate coding at the physical 
layer, combined with ARQ at the Logical Link Control (ARQ-LLC). Then, we present a novel scheme 
based on incremental redundancy Hybrid ARQ (HARQ) that is able to achieve a throughput performance 
arbitrarily close to the "genie-aided service rates", with no need for a genie that provides non-causally 
the ICI power levels. The novel HARQ scheme is both easier to implement and superior in performance 
with respect to the conventional combination of adaptive variable-rate coding and ARQ-LLC. 



Keywords: Multiuser MIMO, inter-cell interference, scheduling, hybrid ARQ, stochastic op- 
timization, game theory. 



I. Introduction 



High-rate data-oriented downlink schemes [|T|, ^ have been successfully deployed as an 
extension of 3G cellular standards (WCDMA and CDMA2000). These schemes are based 
on the results of S-lEl, showing that the throughput (or "ergodic") sum-capacity of single- 
antenna multi-access (uplink) and broadcast (downlink) fading Gaussian channels is achieved 
by allocating opportunistically each time-frequency slot to the user with the best instantaneous 
channel conditions. In a multiuser setting, the sum-capacity is usually not the most meaningful 
measure of the system performance. Instead, maximizing the sum-throughput subject to some 
fairness constraint is more desirable [5]. To this purpose, a downlink scheduling policy can be 
designed in order to maximize a suitable concave and component-wise monotonically increasing 
network utility function over the system's achievable throughput region (i.e., the region of 
achievable long-term average user rates). The network utility function is designed in order to 
capture the desired notion of "fairness" (e.g., proportional fairness, max-min fairness and, more 
in general, a-faimess [|6l). 

In the next generation of cellular systems (e.g., the so-called LTE-Advanced [|7l), high-rate 
data-oriented downlink schemes will be combined with multiuser multi-antenna (MU-MIMO) 
transmission techniques (HI, flU, supporting spectral efficiencies in the lO's of bits/sec/Hz [10], 
[[TT|. With MU-MIMO, the rate supported by each user is generally a function of all the user 
channel vectors, and depends on the type of MU-MIMO precoding [[8l, BH, [fT2l . In order to 
compute the transmitter precoder parameters (e.g., the beamforming steering vectors and the 
transmitted rates and powers), channel state information at the transmitter (CSIT) is required. 
This can be accurately obtained using open and closed loop channel estimation and feedback 
schemes (the literature on this subject is overwhelming, for example, see |[T3l - lfT7l and references 
therein). 



In particular, scheduling with MU-MIMO and non-perfect CSIT was considered in [18], 
particularizing the general stochastic optimization framework of |fT9l to the case of a single- 
cell system with linear Zero-Forcing Beamforming (ZFBF) MU-MIMO precoding, where CSIT 
is obtained via noisy channel estimation and prediction. 

In this work we focus on a multi-cell environment with no inter-cell cooperation. For suffi- 
ciently slowly-moving user terminals it is possible to design training and feedback schemes 
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that achieve almost perfect CSIT lfT6l - lfT8l . Therefore, for simplicity we shall assume that 
each BS has perfect CSIT for its own users. In contrast, in a multi-cell system, inter-cell 
interference (ICI) emerges as another source of unavoidable uncertainty, (see ||20l , ETll and 
references therein). When the schedulers at each BS make their own decisions independently, 
based only on the locally available CSIT relative to their own users, the ICI power seen at each 
user receiver changes on a slot-by slot basis in a random and unpredictable manner, depending 
on the scheduling decision made at all the interfering BSs. As a consequence, the instantaneous 
Signal to Interference plus Noise Ratio (SINR) "seen" at any given user receiver is a random 
variable. 

The decentralized scheduling problem in a multi-cell environment can be formulated as a 
non-cooperative game: each BS (player) wishes to maximize its own utility function over its 
own feasible throughput region. The players' strategies are all feasible scheduling policies. In 
addition, the throughput region of any given cell depends on the ICI power statistics seen at 
the users' receivers, which in turn depend on the scheduling policies applied at the interfering 
BSs. We show that when the individual network utility functions are concave the multi-cell 
decentralized scheduling game is a concave game and therefore Nash equilibria exist. 

In order to solve the network utility maximization at each BS, for given ICI statistics, we apply 
the stochastic optimization framework of ifTSl . [[T9ll , [|22l . Il23l . A straightforward application of 
this approach yields a scheme based on variable-rate adaptive coding at the physical layer, and 
conventional ARQ at the Logical Link Control (LLC) layer. We notice that similar approaches are 
included in several wireless standards such as EV-DO and HSDRA. Il24l - [|26l . and therefore this 
can be regarded as the base-line "conventional" approach. In order to improve upon the conven- 
tional approach, we propose a new method based on combining incremental redundancy Hybrid 
Automatic Retransmission reQuest (HARQ) ll27l and MU-MIMO opportunistic scheduling. In 
the proposed scheme, each user feeds back the value of the instantaneous mutual information 
observed in the previous slot, that is used by the scheduler to update recursively the scheduler 
weights. We show that the throughput achieved by the proposed HARQ scheme approaches 
the throughput of a "virtual system", as if a genie provided non-causally the ICI values at 
each scheduling slot. However, we stress that the proposed scheme makes use of strictly causal 
information, and therefore requires no genie. 
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II. System setup 



We consider the downlink of a system with C > 1 cells. In each cell, a BS equipped with with 
M antennas transmits to K single-antenna users. The channel is assumed frequency flalQ and 
constant over "slots" of length T ^ 1 symbols (block-fading model [28]). Any given channel use 
of the complex baseband discrete-time signal at the k-th user in cell c during slot t is described 



where t ticks at the slot rate, {k,c) denotes user k in cell c, hfc,c,c'[i] G C^^ is the channel 
vector from the c'-th BS antenna array to the {k, c)-th receiver antenna, Xc'[t] G C^^ is the signal 
transmitted by c'-th BS and Zk,c[t] ~ CA/'(0, 1) is the additive white Gaussian noise (AWGN) 
sample. The coefficients gk,c,c' are distance-dependent path gains [f29l that are assumed to be 
time-invariant over many slots. The BSs are sum-power constrained such that tr(Sc[t]) < 1 for 
all t, where Sc[t] = E[xc[t]xjj' [t]] denotes the transmit covariance matrix. The actual channel 
SNR is included as a common scaling factor in the coefficients gk,c,c'- The channel vectors of 
users in cell c form the columns of the channel matrix Hc[t] = [hi c,c[^], hi^,c,c[i]] G C^^^^. 
We assume that all vectors c,c'[i] are mutually independent with i.i.d. components ~ CA/'(0, 1), 
for all distinct 4-tuples (t,k,c,c'). Each BS c knows all time-invariant quantities relative to its 
own users and has perfect knowledge of Hc[t] immediately before the beginning of slot t (perfect 
CSIT for the own users). 

A feasible scheduling policy 7c for BS c is a possibly randomized stationary functior^ that 
maps Hc[t] into the pair 7c(Hc[t]) = (Sc[t], rc[t]), where rc[t] = (ri,c[t], • • • , ri^,cM) is a rate 
allocation vector. We assume that the MU-MIMO precoder is based on linear ZFBF. This yields 
the transmitted signal vector in the form Xc[t] = Xlfces^t] Vfe,c[^]Mfc,c[i], where Sc\t] denotes the set 
of active users, i.e., users that are selected to be served on slot t and where Uk^c[t] G C denotes 
the coded symbol for user (A;,c), with power E[|nfc c[t]p] = Pk,c[t]- The ZFBF steering vectors 
{vfc,c[^] : k E Sc[t\} are given by the unit-norm (normalized) k-th column of the Moore-Penrose 

'The generalization to MIMO-OFDM and frequency selective fading is immediate. 

^Using tlie tlieory developed in II30I we can show that restricting to stationary policies does involve any suboptimality in 
terms of the achievable throughput region. 



by 
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pseudoinverse (e.g., see lfT4]| . |fT6l . IfTSl . [1311 . [[32ll and references therein) of the channel matrix 
restricted to the active users, i.e., to the columns {h^ c,cM : k G 5cM}- It follows that the transmit 
covariance matrix takes on the form 

ScM = Yl ^k,c[tKclt]Pk,M- (2) 

keSc[t] 

where non-negative coefficients {-Pfe,c[i] : k E Sc[t]} define the power allocation over the 
active users in cell c, and satisfy the power constraint J2keSc[t] ■^'^'^l^'^ ^ 1- A necessary and 
sufficient condition for perfect zero-forcing of the intra-cell multiuser interference is that \Sc[t\ \ < 
min{M, K}. Without loss of generality, in the following we identify the set of active users Sc[t] 
with those users with positive powers, i.e., Pk,c[t] > for /c G Sc[t] and Pk,c[t] = for A; ^ Sc[t]. 
The ICI power at user {k,c) receiver in slot t is given by 

XkAt] = 9k,c,c'hl,jt]i:4t]hk,cAt] (3) 

with mean given by Xk,c = HXk,c[t]] = T^dj^c 9k,c,Ar{'Ec'[t]). The SINK at user {k,c) is given 
by 

sinrfc,ct = ^ r:^ (4) 

1 + Xk,c[t] 

We let Rk,c[t] denote the instantaneous service rate of user (/c, c) on slot t, measured in 
bits/channel use. This is in general a function of sinrfc^c[^], and therefore of Hc[t], 5]c[t], Xk,c\t], and 
of the allocated rate rfc,c[i]- We define the /c-th user service rate function Rk{g, H, x, S, r), such 
that Rk,c[t] = Rk{gk,c,c^'^c\t],Xk,c\t]^'^c\t],'i^c\t\)- r denote the set of all feasible scheduling 
policies and let 7_c = {7c' '■ c' ^ c} denote the set of scheduling policies at all cells c' 7^ c. For 
fixed 7_c G r*"~^, the throughput of user (/c, c) under the scheduling policy 7c is given by 



— 1 

-Rfc,c(7c, 7-c) = liminf- V'i?fc(5(fc,c,c, Hc[r],Xfc,c[r],7c(Hc[r])) 

t-+oo t •^"^ 

T = l 

= E[i?fc(5(fc,c,c,Hc,Xfc,c,7c(Hc))] (5) 



where the effect of the policies at the interfering BSs is captured by the statistics of the ICI 
power process Xfc,cM> the limit holds almost surely because of stationarity and ergodicity, and 
expectation is with respect to the joint distribution of the triple (Hc[t], Xfc,cM, 7c)- □ The region 

^With some abuse of notation, we denote by He and {xk.c ■ k — 1,...,K} random variables whose joint distribution 
coincides with the first-order joint distribution of the processes Hc[f] and {xfe.c[i] : k = 1, . . . , which is time-invariant by 
stationarity. 



5 



of achievable throughputs for cell c is given by 

7^c(7-c) = coh y {R G M^' : < E [Rk{gk,c,c. H„ Xfc.c, 7c(H,))] , V A;} (6) 

7c er 

"coh" denotes "closure of the convex hull". Notice that 7^c(7-c) depends on the other cells' 
scheduling policies 7_c through the joint probability distribution of the ICI powers {xk,c ■ k = 

Under our assumptions, the BSs operate in a decentralized way and influence each other only 
in terms of the generated ICI statistics (i.e., the joint cdfs {xk,c '■ k = 1, . . . ,K}). Each BS 
wishes to maximize its own network utility function. This multi-objective optimization problem 
is formulated as a non-cooperative game ll33l . [|34ll that we nickname the multi-cell decentralized 
scheduling game, where each player (i.e., BS) c seeks to achieve 

maximize f/c(R-) 

subject to Re 7^c(7-c) (7) 

where we assume that Uc{-) is a continuous, strictly concave and component- wise increasing 
utility function, reflecting some suitable fairness criterion 

By definition, for any given joint statistics of and of {xk,c : k = 1, . . . , K}, the maximum in 
^ is achieved by some scheduling policy 7*. A Nash equilibrium of the decentralized scheduling 
game is a set of scheduling policies (also denoted, with some abuse of notation, by {7* : c = 
1, . . . , C}) such that 7* is the solution to ^ when 7_c = 7*c' all c = 1, . . . , C. We have: 

Theorem 1: The decentralized scheduling game defined above is a concave game and therefore 
has a Nash equilibrium. 

Proof: All players have the same strategy set V. This is a compact convex set due to the 
covariance trace constraint and to the fact that we can assume that the rate allocation vector is 
bounded in G [0, rmax]^ for some constant rmax- Q Also, each c-th utility is a concave function 
of 7c for fixed 7_c- In order to see this, let R(7c,7_c) denote the throughput point of Tlc{'j-.c) 
achieved by policy 7c for fixed 7_c, consider any two policies 7^, 7^' G F and define 7c^^ as the 
policy that applies 7^ with probability A G [0, 1] and 7^' with probability A = 1 — A. Then, from 

''This limitation does not involve any significant loss of generality if rmax is sufficiently large, and always holds in practice 
since practical variable-rate coding has a finite maximum rate. 
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the convexity of TZd^^c) and the concavity of Uc{-) we have that 



A[/,(R(7^,7-c)) + Af/e(R(7:',7-c)) < f/c(AR(7^, 7-c) + AR(7:',7-c)) = U,{Kili'\l-c)) 



Now, let 7 = {7c : c = 1, . . . , C} and 7' = {7^ : c = 1, . . . , C} denote two vectors of scheduling 
policies and define the sum-utility function p(7, 7') = Yl^=i ^c(R(7c5 7^c))- Since the functions 
Uc{-) are continuous (by assumption) and the throughput vectors are continuous functions of the 
scheduling policies, it follows that p(7, 7') is a continuous function of (7, 7') eT'-^ x T'^ and, 
for what said before, it is concave in 7 for any fixed 7'. These properties match exactly the 
assumption of Rosen Theorem ll35l . Therefore, as a direct consequence of ll35l . the existence of 
a Nash equilibrium is proved. ■ 

Since Uc{-) is component- wise increasing, it follows that the maximum of (|7]) is obtained for 
some 7* such that R(7*,7_c) is on the Pareto boundary of 7^c(7-c)- If the service rate function 
Rk{g, H, X, S, r) is strictly increasing in the power allocated to user k, then the Pareto boundary 
of TZci'y-c) is achieved by policies that satisfy tr (Sc[t]) = J2k&Sc[t] -^fc.cM = 1 with probability 
1. In this case, any Nash equilibrium {7* : c = 1, . . . , C} must correspond to scheduling policies 
that achieve the power constraint with equality for all BSs. 

In Sections UlI] and |IV] we will focus on reference cell c, assuming that all other interfering 
cells apply a fixed arbitrary policy 7_c (i-C-, for fixed and known joint statistics of the ICI powers 
at all users of cell c). We shall apply the theory developed in [[TSl . |fT9l and provide a stochastic 
optimization algorithm that solves © to any desired level of approximation, for any given ICI 
powers statistics. 

III. Scheduling with adaptive variable-rate coding and ARQ-LLC 

From now on we shall assume Gaussian random coding and consider specific cases of service 
rate functions. In this case, we define the A;-th user mutual information function as 



The mutual information at user (k, c) receiver on slot t is given by Ik,c[^] = Ik{gk,c,c, Hc[t], Xfc,c[^]5 5]c[t]). 
We approximate the decoding error probability by the corresponding information outage proba- 
bility (see Il28l , [|36l for the information-theoretic motivations underlying this very common and 
very useful approximation). Namely, if the mutual information Ik,c\t] is less than the scheduled 




(8) 
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coding rate rfc c[t], the decoder makes a decoding error with probability close to 1, while if 
Ik,c[t] > '"fe.cM the random coding average error probability is very close to 0. Therefore, for 
slot length T large enough, there exist "good" codes drawn from a Gaussian ensemble such that 
their block error probability is close to the information outage probability P(rfc > Ik,c[^])- In 
this case, the user k service rate function is given by "outage rate" function [[TSl 



R,{g, H, X, S, r) = rfc X 1 {r < hig, H, x, S)} (9) 



In order to obtain the desired near-optimal scheduling policy, we apply the framework of 1181. 
We define the virtual queued with buffer state Qc[t] = {Qi,c[t], ■ ■ ■ ,QK,c[t]) and virtual arrival 
processes Ac[t] = (Ai^cM, • • • , ^i^,cM)- The virtual queues evolve according to the stochastic 
difference equations 

Qfe,,[t + 1] = max {0,Qfc,e[t] -i?fc,cM} + Afc,cM, k = 1, . . . , K (10) 

Then, we consider the adaptive policy defined by: 

1) For any given t, let the transmit covariance matrix Sc[^] and the rate allocation vector rdt] 
be the solution of 

K 

maximize ^ Qk,c[t] ^ [^fc,cM x 1 {n,c[t] < Iki9k,c,c, HM, Xfc.cM, S,, ,[t])}| H,[t]] 

k=l 

subject to tr (Sc[t]) < 1, rk,c[t] > V A; 

(11) 

2) For suitable constants V, Amax > 0, let the virtual arrival processes at time t be given by 
the solution of 

K 

max VU,{A,[t])-y^AkAt]Qk.c[t] (12) 

k=l 

3) Update the virtual queues according to (flOl) . with arrivals Ac[t] given by (fT2)) and service 
rates Rk,c[t] given by ^ calculated for Sc[t] and rdt] solutions of (fTTI) . 

As stated in Theorem [2] below, the policy defined above achieves the optimal point solution 
of ([7]) within any desired accuracy, depending on the constants V and A^^.^. Neglecting the 
(small) degradation due to stochastic adaptation and quantified by Theorem [2l we shall refer to 
this policy as 7*. 



^It is important to keep in mind tiiat the virtual queues have nothing to do with the ARQ transmission buffers: they are used 
here as a tool to recursively update the weights of the the scheduling policy. 
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Theorem 2: Assume i.i.d. channels and fixed joint statistics of the ICI powers {xk,c '■ k = 
1, . . . , K}. Assume that Uc{-) is concave and entry-wise non-decreasing, and that there exists at 
least one point r G TZd'j-c) with strictly positive entries such that f/c(r/2) > — oo. Then, the 
scheduling policy 7* defined above, for given constants V > and A^^ax > 0, has the following 
properties: 

(a) The utility achieved by 7* satisfies: 

lim mf (^j J2 j > f/c(R*(A^ax)) - t^/V (13) 



where 

K 



(14) 



and where Rc(^max) denotes the solution of the problem ([7]) with the additional constraint 
< Rk,c < Amax for all A; = 1, . . . , i^. 

(b) For any point Rc G TZci'lc' d ^ c) such that < i?fc,c < ^max for all k, and for any 
value /3 G [0, 1] we have: 

hmsup - > > i?fc,cE[(5fc,c[r]] < (15) 

i^oo t ^ ^ J- — P 

T = l fe = l [-1 

Thus, all virtual queues (5a,-,c[^] are strongly stablecl 

Proof: The proof follows verbatim from the results in ifTSl and it is not repeated here for 
brevity. ■ 
As a corollary of Theorem |2l if Amax is sufficiently large such that Amax > -Rfc,c f*^^ ^ k, 
then 7* satisfies 

lim inf f/e I 7 y Rc[r] I > U^iX) - f^/V- (16) 

Hence, the control parameter V can be chosen sufficiently large in order to make the achieved 
utility as close as desired to the optimal value Uc(R*) of problem (|7]). This comes with a tradeoff 
in the virtual queue average sizes that, as seen from (fT5l) . grow linearly with V. The virtual queue 
sizes represent the difference between the virtual bits admitted into the queues and the actual 
bits transmitted, and thus affect the time- scales required for the time averages to become close 
to their limiting values. 

* A discrete-time queue Qk[t] is strongly stable if limsupj^^ j X]t=i ^^lOfc [''']] < The system is strongly stable if all 
queues k — 1, . . . ,K are strongly stable. 
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A. Implementation 

The policy 7* found before computes recursively the "weights" Qc[t] via (fT2l) and (flOl ) 
and, for each t, solves the weighted conditional average rate sum maximization (fTT)) . Problem 
(fT2l) is a standard convex optimization problem the solution of which does not present any 
major conceptual difficulty and is found in closed form for the important cases of proportional 
fairness and max-min fairness (see [18]), corresponding to the choices Uc{^) = Yl!k=i^^^Rk 
and Uc(R) = min^ R^, respectively. In contrast, solving (fTTI) presents some difficulties. Letting 
Ffe c(-) denote the marginal cdf of Xk,c[^] ^'^^ using ([8]), the objective function in (fTT)) can be 
rewritten as 



The optimization in (fTTI) is generally a non-convex problem that involves a combinatorial search 
over all subsets Sc[t] C {1, . . . , K} of cardinality < min{i^, M} and, for each candidate subset, 
the maximization of (fTTI) with respect to Vc[t] and the power allocation {Pfc,c[^] : k E Sc[t]}. 
Since this optimization may be difficult to compute, we propose the following suboptimal low- 
complexity two-step approach: 

Step 1) the active user subset and the corresponding power allocation are selected by assuming 
deterministic ICI powers, equal to their mean value Xk,c- Under this assumption, the problem is 
reduced to the well-known user selection with ZFBF, that can be solved using standard techniques 
based on quasi-orthogonal user selection and waterfilling (e.g., [f37ll - [f39ll ). 

Step 2) for the transmit covariance Sc[t] obtained in step 1, (fTTI) is optimized with respect to 
the rate allocation. This reduces to optimizing the outage rate separately for each k E Sk,c[t] by 
letting 



where gk,c,c \^k,c,c[t]^k,M\ Pk,M ^^^d by Step 1. 

Notice that, both in the original problem and in the proposed low-complexity two-step ap- 
proximated solution, only the marginal statistics of the ICI powers {xfc,c[i] : k = 1, . . . , K} are 
relevant. These marginal statistics can be measured by each user terminal individually and fed 
back to the BS scheduler by some very low-rate feedback scheme. 




(17) 




(18) 
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IV. Scheduling with incremental redundancy HARQ 

If a genie provides the BS scheduler with the values of the the mutual information {/fc,c[^] : 
k = 1, . . . , K} in a non-causal fashion, just before the beginning of slot t, then the optimal rate 
allocation would be, trivially, rk,c[t] = Ik,c[^] for all k E Sc[t], yielding zero outage probability. 
This "genie-aided" case was considered in flTSl and referred to as "optimistic rate" allocation, 
although no actual algorithm to approach the optimistic throughput was given. Since for any 
non-negative random variable / and r > we have E[rl{r > /}] < E[/], then the optimistic 
service rates provide an upper bound to the throughput of any system with the same signaling 
scheme (ZFBF and Gaussian codes) and given rate allocation. 

In this section we show how to achieve the "optimistic" throughput without the aid of any 
genie. As a preliminary step, let's consider the following incremental redundancy HARQ scheme. 
The BS scheduler maintains a buffer of information packets for each user in the cell. The size of 
user [k, c) packets is equal to huc bits per packet. Each packet is encoded into an infinite-length 
sequence of complex symbols The encoded sequence is partitioned into blocks of length T 
symbols. At each slot t, the scheduling policy computes Yijyt] according to some rule to be 
found later. For all active users k E Sc[t], if the most recent HARQ feedback message from user 
k is "NACK" (negative acknowledgement), then the first not-yet transmitted coded block of the 
current packet is transmitted. Otherwise, if the most recent received HARQ feedback message is 
"ACK" (positive acknowledgement), then the current packet is removed from the transmission 
buffer of user k and the first coded block of next packet in the buffer is transmitted. The (A;, c)- 
th receiver stores in memory all the received slots for times {t : k E Sc[t]} and attempts to 
decode the current packet at every newly received slot, by using all the available received slots. 
If decoding fails, NACK is sent back, otherwise ACK is sent back and the decoder memory is 
reset. Notice that the scheme does not require any genie-aided "look-ahead" of the instantaneous 
ICI power Xfc.c^j and makes use of time-invariant packet sizes 6fc,c- These may differ from user 
to user but are independent of t. For later use, we define the "first-block coding rate" as the 
ratio rk,c = %^ bits/channel use. 

Next, we describe a scheduling rule, denoted again by 7*, that operates arbitrarily closely 
to the genie-aided throughput when combined with the HARQ scheme described above. At the 



^In practice, this rateless coding can be implemented by using Raptor codes 1401 . 
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end of each slot t, the active users k E Sc[t] feed back both their ACK/NACK message and the 
mutual information Ik,c[t] "seen" at their receiver. Then, 7* coincides with what given in Section 
Hill after the following two changes. 1) The virtual queues evolution equation (flOl ) is replaced 
by 

QkAt + 1] = max {0, Qk,c[t] - 4,cM} + A,cM, V k (19) 
2) The transmitter optimization (fTTj) is replaced by 

K 

maximize ^ Qfc,cM E [4(5'fc,c,c, Hc[t], Xfc,cM, ^c[t])\ Hc[t]] 
k=i 

subject to tr(Sc[t]) < 1 
In brief, the scheduler updates recursively its weights Qc[t] and computes the transmitted signal 
covariance Sc[t] according to (|20|) . as if it was operating on a virtual "genie-aided" system 
with instantaneous service rates Ik,c[t]- The throughput region of the virtual genie-aided system, 
denoted by 7^f™'''(7_c), is given by Q, after replacing the general rate function Rk{- ■ ■) with 
the mutual information function Ik{- ■ ■) defined in ([8]). The performance of 7* for the genie- 
aided system is again given by Theorem [21 where Rc['r] in ([T3l) is replaced by the vector of 
mutual informations Ic[r] = (Ji c[t, . . . , /x,c[t]) and where R (Amax) denotes the solution of 
^ when 7^c(7-c) is replaced by 7?.f'^"''^(7_c), with the additional constraint < Rk,c < ^max 
for all k=l,...,K. 

For sufficiently large Amax^ 1* yields: 



lim inf Uc 

t->-oo \ t 



ij^i^M) >t/,(Rr-)-./K (21) 



T=l 



where R^ ' is the utility-maximizing throughput point in the region 7?.f°"°(7_c). At this point, 
it remains to be shown that the combination of the policy 7* with the incremental redundancy 
HARQ scheme yields a network utility as close as desired to the limit in (|2T1) . This is shown 
by the following: 

=--harq,* ,-=-harq,* -=-harq,5t, 

Theorem 3: Let R^ = (it^^ , . . . , it^^ ) denote the throughput achievable by the 
incremental redundancy HARQ protocol under scheduling policy 7* defined above. For each 
user {k, c) and ek,c > there exists a sufficiently large first-block rate rk,c such that R^^^^'* > 
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Proof: Consider user (A;,c). Following the argument in [|27ll . we can model the event of 
successful decoding as a "mutual information level-crossing event". Suppose that the transmission 
of the current packet for user (/c, c) starts at slot tstart (i-e-? an ACK was fed back at slot 
time tstart — !)• Then, the current packet can be successfully decoded at slot t > tstart if 
Xl!-=tstait ^^A'^] — ^k,c- Otherwise, a decoding error occurs with very high probability. As 
shown in [|27l , ||4T]| . the probability of undetected decoding error vanishes exponentially with 
T. Therefore, in the regime of large T, if X]!-=tstart ^k,c['^] < ^k,c the decoding error is detected 
with arbitrarily high probability and a NACK is sent back. Fig. [T] shows, qualitatively, the mutual 
information level-crossing and the corresponding successful decoding events of the (k, c) decoder. 
Notice that the mutual information increment is non-negative, and it is exactly zero for all t such 
that k ^ Sc[t], i.e., when user {k,c) is not scheduled. 

Consider the transmission of a long sequence of packets. Without loss of generality, assume 
that the system starts at time tstart = 1, denote by Nk,c[t] the number of successful decoding 
events of decoder {k,c) up to time t and let li^ cll), W4,c(2), . . . , H4,c(^fc,cM) denote the 
corresponding "inter-ACK" times (see Fig. [I]). Since at each successful decoding a "reward" 
of Tfc c bit per channel use is delivered to the destination, the throughput of the HARQ protocols 
is given by 

= lim , (22) 

where Ak,c[t] = t — J2n=i*'^ Wk^dn) denotes the difference between the current time t and the 
time at which the A'^fc c[^]-th successful decoding occurred. Under the assumptions of this paper, 
the system with HARQ protocol and scheduling policy 7* evolves according to a discrete- 
time, continuous-valued vector Markov process with state given by Qc[t] and by the vector of 
accumulated mutual informations at each receiver. Since the virtual queues are strongly stable 
(see Theorem [2I) and the accumulated mutual informations are bounded in [0,rfe c], the process 
is stationary and ergodic. Therefore, the limit in ((22)) holds almost surely, and can be explicitly 
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computed as follows: 



t-^oo 1 



r_k^ 

'^fc.c ^23) 



where Wk,c is an integer-valued random variable with the same marginal distribution of the 
inter- ACK times. 

In order to determine E[W^fc c], consider the case tstart = 1 and define the event 

= \^h[r] < rfe,,| (24) 

Since the accumulated mutual information between two ACKs is non-decreasing, the following 
nesting condition holds: 

where ^fe,c[0] = {0 < r,.^c} has probability 1. It follows that 

^{Wk^c = t) = P(A,c[t - 1], A,cM) = P(A,c[t - 1]) - P(A.,cM), 

yielding the average inter- ACK time in the form 

oo 



t=l 

oo 



l + 5^P(A,c[t]) (25) 



t=l 



Owing to the complete formal analogy of results (|23] ) and (|25l) with the throughput of HARQ 
considered in [|27l ). we can directly apply the limit proved in [|27l : ^ 

li"^ l^J^T^ = ^ t^*^ (5'fc,c,c, He, Xk,c, SJ] (26) 

^This result is indeed quite intuitive: wlien rk,c becomes large, then ]E[Wfe_cl increases. Therefore, the accumulated mutual 
information divided by the number of slots 12^=1 {gk,c,c, Hc[t], Xfe-cfT], Sc[r]) converges to an ensemble average. It 
follows that in this limit the level crossing condition tends to become deterministic, and satisfies (approximately) 

/fc (5fe,c,c,Hc[r],Xfe,c[T],Ec[r]) = Wk,crk,c 

T = l 

Of course, this argument can be made rigorous by following in the footsteps of 127 1 . 
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In particular, as c — ^ oo the average inter- ACK time E[Vrfc_c] diverges to infinity linearly with 
Tfc^c- The analysis in ll27l shows that, for any 77^ ^ > 0, 

rIT'* > (1 - Vk,c)^ [h {9k,c,c, He, Xk,c, Sc)] (27) 

for all sufficiently large c- 

The proof of Lemma [3] is finally concluded by combining the result (l26l) with (|2T]) . By 
stationarity and ergodicity, under 7* we have that 

1 * 

lim - y~] Ik,cM = IE [4 igk,c,c, He, Xfc.c, Sc)] 

r=l 

holds almost surely. Since Uc{-) is component- wise increasing, (|2T1) implies that for any 5^ c > 
there exist sufficiently large A^ax and V for which 

E [4 {gk,c,c, H„ Xfc,c, S,)] > (1 - 4,c)^fc'f * (28) 

By letting (1 — ek,c) = (1 — Vk,c){^ — Sk,c) and using (|T7l) and (l28l) Theorem [3] is proved. ■ 
From the above proof it follows that the delay-throughput operating point of the incremental 
redundancy HARQ protocol can be chosen individually for each user by setting the threshold 
value Tfc c (or, equivalently, the size bk,c of the information packets). By making c large, the 
average decoding delay Dk^c = ^[Wk,c] becomes large and the throughput approaches ^ ' . 

Also, we wish to stress the difference between the ARQ-LLC scheme described in Section 
In] and the incremental-redundancy HARQ protocol illustrated in this section. The ARQ-LLC 
protocol makes use of adaptive variable-rate coding at the physical layer, and removes or keeps 
in the transmission buffer packets of information bits of variable size 6^ = Trk^dt] - In contrast, 
the HARQ protocol make use of a fixed packet size bk,c (equivalent to fixed first-block rate c), 
but the effective service rate is adaptive by varying the decoding delay through the ACK/NACK 
mechanism. 

A. Implementation 

The scheme previously proposed requires that each active user, at the end of each slot t, feeds 
back a message formed by one bit for ACK/NACK and by the value of Ik,c\t\ or, equivalently, 
the value of sinrfe c[i]- We notice that feeding back the instantaneous SINR is widely proposed 
in the literature on opportunistic downlink scheduling W2\ . [|43l and it is referred to as Channel 
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Quality Indicator (CQI). However, in the current literature the CQI is relative to the current slot, 
and it is used to select users and allocate the rate of a variable-rate coding scheme. In contrast, 
here the CQI refers to the past slot, and it is used to update the scheduler weights according to 

Denoting again by -Ffe,c(-) the marginal cdf of Xfc,c[^], the objective function in (|20|) can be 
rewritten as 

T.keSM Qf'AA log I 1 + l + z ) '^^''A^^ ^^^^ 

While for any fixed user subset Sc[t] the maximization of ( |29l ) with respect to the powers 
{-Pfc,c[^] : k E Sc[t]} is a convex problem, the solution is not generally given by the simple 
waterfilling formula and it may be difficult to compute since the cdfs -Ffc c(-) are typically not 
known in closed form. A near-optimum low-complexity approximation consists of choosing Sc[t] 
that maximizes the objective function lower bound 

Ekes4t] QkAt] log 1 1 + YTfk 1 



obtained by applying Jensen's inequality to (1291) . Notice that the maximization of (1301) with 
respect to the transmit covariance matrix coincides with step 1 in the low-complexity approxi- 
mation of the variable-rate coding/ ARQ-LLC case of Section IIII-A[ and can be solved efficiently 
using the methods in Il37]|-ll39]l. 

B. Extremal ICI distributions 

The throughput performance of the HARQ scheme depends on the statistics of the ICI powers, 
which in turns depend on the scheduling policies 7_c at the interfering BSs. In this section we 
find extremal marginal statistics for the ICI powers that provide non-trivial inner and outer bounds 
to 7^^'^"^'^(7-c) that are independent of 7_c. Here we drop the slot index t since all processes are 
stationary. We start with the following: 

Lemma 1: For all feasible policies 7c' : c' ^ c that satisfy the input power constraint with 
equality and for all users k = 1, . . . , K, we have 

^[Ik{gk,c,c, He, Xfc,c, 5]c)] < E[h{gk,c,c, He, Xfc.c, SJ] < E[Ik{gk,c,c, H^, Xk,c, SJ] (31) 

where Xk,c = HXk,c] = Y.c'^c9k,c,c' and where Xk,c = J2c'^c9k,c,c' |hfc,c,c'Vi,c' |^ is the ICI power 
at the {k, c) receiver when all interfering BSs c' ^ c' schedule a single user in their own cell. 
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Proof: The first inequality (lower bound) follows immediately from Jensen's inequality 
applied to the convex function f{x) = log(l + -j^) with a,b > 0, and by the fact that, by 
assumption, the interfering BSs use all their available power. In order to show the second in- 
equality (upper bound), we use © in © and write Xk,c = Y.c'^c9k,c,c' T^jes^, Cik,c,c',jPj,c', where 
jj = cc'^j,c'\'^ arc random variables independent of the SINR numerator |h^^ ^v/; cP-Pfc,c- 



Since the ZFBF steering vectors c' have unit norm and are independent of c,cs the variables 
«fc,c,c',j are marginally identically distributed as central chi-squared with 2 degrees of freedom 
ll44l . Also, notice that the afc,c,c',/s are statistically dependent for the same index c', while 
{oik,c,c',j '■ j G <Sc'} and {ak,c,c",j ■ j G <Sc"} are group-wise mutually independent for c' ^ c". By 
assumption, J2j£S , -^i.c = 1 for all c' . Therefore, Yl-jt^s , '^k,c,c',jPj,c' is a convex combination 
of identically distributed, possibly dependent, random variables. The second inequality in (|3TI) 
follows by repeated application of Jensen's inequality. Choose c" ^ c. Then, using ([8]), we have 



E 



E 



log 1 + 



log 1 



1 + Xk,c 



gk,c,c\h.^^c,c^k,c\ Pi 



< 



k,c 



1 + gk,c,c"ak,c,c",j + Z)cVc,c" 9k,c,c' YjeS,, Oik,c,c',jPj,, 



E 



log 1 + 



gk,c,c Vfc 



p 



k,c 



(32) 



1 + gk,c,c"Olk,c,c",l + J2c'ytc,c" gk,c,c> YljeS^i ^k,c,d ,jPj,c' 

where the equality in (1321) follows from the fact that the Q;fc,c,c",/s are identically distributed with 
respect to the index j. Next, pick c'" ^ c, c", and apply the same steps to the last line of (|32|) . 
After eliminating all convex combinations, the final upper bound coincides with the right most 
term in (HB- ■ 
As a corollary, we have the following interesting "robustness" result: 

Theorem 4: For any choice of the scheduling policies 7_c that satisfy the input power con- 
straint with equality, we have 

C 7^f "'*'(7_e) C ^^f^'^ (33) 
where He is the region with deterministic ICI powers {xa, c}S ^'^^ where 7^^'^'^^'^ is the region 



Notice that if the ICI powers were deterministic, then no genie or HARQ is needed and the system reduces to a collection 



of isolated cells, where each cell c has modified channel path gain coefficients 5^ ^ c ~ T 



+ Xfc,c 



In this case, the throughput 

region 7?,c is achieved by the standard scheduling/resource allocation schemes with perfect state information and zero outage 
probability. 
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corresponding to random ICI powers {Xk,c}- Furthermore, the gap between the inner and outer 
bounds in (l33l) is bounded by a constant that does not depend on the channel path coefficients. 

Proof: The proof (1331 ) follows directly as a consequence of Lemma [TJ In order to show the 
bounded gap, we have to find some constant A, independent of {gk,c,c'}, such that max{r — 
A1,0} G TZc for all points r G 7^^'^'"'^. To this purpose, pick a point r G 7^^'^'"'^ corresponding 
to some feasible scheduling policy 7c for the genie-aided system. Applying the same sequence 
of input covariance matrices as determined by 7c, to the system with deterministic ICI powers, 
we certainly find a point Rc(7c) G TZc- Consider the throughput of the A;-th user and let for 
convenience A = g^^cc \ ^kcc^k,c\ Pk,c- Then, by applying Jensen's inequality we have 



E 



log ( 1 + tte:; 



T^c 9k,c,c"^k,c,c' ,1 



A 



log (l + ) 



< 



log ( 1 + ^c'^c9k,c,c'] - IE log ( 1 + T.c'ytc9k,c,c'ak,c,c',l 



(34) 



The RHS in the above inequality is easily seen to be non-negative and component- wise increasing 
with respect to any coefficient gk,c,c'- Therefore, its maximum is obtained in the limit for all 
gk,c,c' — ^ oo (in passing, we notice that this corresponds to considering the interference-limited 
regime where SNR — )■ oo). In order to see that this limit is finite, let (yfmax = ^^^gk,c,c', then 
we have 



RHS of® < log(l + (C-l)(7max)-E 



log 1 + fi'max / ^ ^k,c,c',l 



< 



-E 



log 



c 



«fc,c,c',l 



< -E [log (afc,c,cM)] 

< 7/ln(2) 



(35) 

(36) 
(37) 



where (1351 ) follows by letting (yf^ax — ^ C)0, (|36] ) follows by applying Jensen's inequality to the 
convex function — logx and (l37l) follows by using the fact that afc,c,c',i is chi-squared with 2 
degrees of freedom, and using the limit lim^j^o lyixe'^dx = —7, where 7 denotes the Euler- 
Mascheroni constant [|45l . ■ 
Theorem |4] has the following interesting consequence: consider the multi-cell decentralized 
scheduling game under the proposed incremental redundancy HARQ scheme, achieving the 
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genie-aided throughput region in each cell. The performance of any given cell c (in terms of 
its network utility value) at any Nash equilibrium (7^", . . . , 7^) is bounded below and above by 
the solutions of © when 7^^™'°(7*c) replaced by TZc and Ttf™"^, respectively. This follows 
from the fact that, as argued at the end of Section UIl all Nash equilibria must achieve the power 
constraints with equality at each BS^^ 

V. Numerical results 

We considered a simple one-dimensional cellular layout with unit width cells arranged on a 
line. BSs are located at integer positions c G Z. In each cell c, users are placed on a uniform grid 
in positions n(A;, c) = {2k — K — l)/{2K)+c,foxk = l,--- , /T. The channel path gains are given 
by gk,c,c' = i+Qy,(^k,f)-c'\c/5r ' where the modulo-C distance \u-c\c = min{|n-c + zC| : z e Z} 
induces a torus topology that eliminates border effects and where u and 6 are the propagation 
exponent and the 3dB breakpoint distance, respectively, and Go determines the received SNR 
at the cell edge [|29l . We present results for a system with C = 18 cells, M = 2 antennas 
per BS, K = 36 users per cell and parameters Gq = 60dB, a = 3.0 and 6 = 0.05. For the 
implementation of the policy 7^ we chose parameters Amax = 50, V = 50 and suboptimal 
low-complexity approximations as explained in Sections [III-AI and IIV-A[ respectively. As for the 
network utility functions, we considered both proportional fairness and max-min fairness (see 
Section UlI-AI and flU, ifTSl and references therein). In order to gather the ICI statistics, we run 
the same scheduling algorithm in all BSs and measure the empirical cdf of the ICI power at 
each user location in the reference cell c = (since the system is completely symmetric, all 
cells see the same ICI statistics). 

Figs. [2] and |3] compare user throughputs in cell c = under proportional fairness and max-min 
fairness, respectively. Thick dashed lines illustrate the throughput upper bounds of Theorem |4l 
Thin dashed lines correspond to the actual "genie-aided" rates achievable by the proposed HARQ 
scheme in the limit of infinite decoding delay. Solid lines show the throughput achieved by the 
HARQ scheme operating at finite average decoding delay for all users, by setting the parameters 
{r/c 0} such that each user achieves 97% of the genie-aided rates (infinite delay). The "triangle" 
marks indicate the throughput lower bounds of Theorem ID Finally, the "square" marks indicate 

'"Notice that the mutual information function is strictly increasing with the SINR. 
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the throughputs achieved by the conventional adaptive variable-rate coding with ARQ-LLC. We 
observe that under both fairness objective functions, the throughputs achieved by HARQ achieve 
a gain of more than 100% for the users at the edge of the cell in the proportional fairness case, 
and a throughput gain of more than 40% for all users in the max-min fairness case, with respect 
to the ARQ-LLC scheme. 

Figs, in and [5] illustrate the average throughput as a function of the average decoding delay for 
the HARQ scheme in the case of two specific users: user (1, 0) at the left cell edge and (18, 0) at 
the cell center, under proportional fairness and max-min fairness, respectively. The thick dashed 
lines show genie-aided rates. The solid lines are obtained by increasing first-block coding rate 
parameter r^o and computing average decoding delay from (l25l) with P(^jfcoM) obtained by 
Monte Carlo simulation. Note that as r^ o increases, also the delay E[M4 o] increases and the 
HARQ throughputs approach the genie-aided throughputs, in agreement with Theorem [3l The 
"o" marks indicate the throughput-delay points at which the HARQ protocol achieves 70%, 80% 
and 90% of the genie-aided throughput based on simulations. For example, under proportional 
fairness, 90% of the genie-aided throughput can be achieved at users (1,0) and (18,0) with 
average decoding delays of about 57 and 126 slots, respectively. These points (obtained by full 
system simulation) are accurately predicted by the analytical formulas of Section |W] fitted with 
the Monte Carlo estimation of the probabilities P(^s. o[t]). 

For K = 36 users per cell and M = 2 BS antennas, assuming that exactly M = 2 users 
are served in each slot, a round-robin scheduling with no outage (genie-aided rate allocation) 
would take an average delay of 18 slots. Remarkably, under proportional fairness, 90% of the 
genie-aided throughput can be achieved with about 57 slots of average delay for center user. This 
is only ^ 3 times that of the genie-aided round-robin scheduling. For edge users, this is achieved 
with ^ 126 slots of average delay for the edge users, which is only 7 times that of round-robin. 
Under max-min fairness, both users (1,0) and (18,0) achieve genie-aided throughputs close to 
0.25 bits/channel use. The decoding delay for the center user is larger than for the edge user due 
to the fact that center users are scheduled very rarely. For the 70% point, edge users achieve 0.16 
bits/channel use with average delay of 18 slots while center users achieves a similar throughput 
of 0.18 bits/channel use with delay of 44 slots. 
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VI. Concluding remarks 

In this work we considered decentralized downlink scheduling in a multi-cell environment 
with multi-antenna BSs, where the scheduler at each BS has perfect CSIT about its own users 
and statistical information about the ICI caused by the other cells. Since each BS modifies 
its transmit covariance matrix at every slot, the ICI powers experienced at the users' receivers 
are random variable. We addressed the scheduling problem in the presence of uncertain ICI 
powers in the framework of stochastic network optimization. A straightforward application of this 
framework yields a conventional scheme based on adaptive variable-rate coding at the physical 
layer, and ARQ at the Logical Link Control layer. Then, a new combination of the same stochastic 
network optimization framework with incremental redundancy Hybrid ARQ at the physical layer 
was shown to improve over the conventional scheme, and achieve a network utility arbitrarily 
close to the performance of a genie-aided system that can schedule the user rates equal to the 
(non-causally known) instantaneous mutual information on each slot. For this scheme, we also 
showed that all Nash equilibria of the multi-cell decentralized scheduling game yield network 
utility values that can be uniformly upper and lower bounded by virtual systems corresponding 
to "extremal" ICI statistics, where the lower bound corresponds to the case of deterministic 
ICI powers equal to their mean values, and the upper bound corresponds to the case where all 
interfering BSs transmit to a single user at full power (rank 1 interfering covariance matrices). 
These bounds stay at a fixed gap that is independent of the cellular system configuration, i.e., 
of the channel path gain coefficients and operating SNR. The proposed incremental redundancy 
HARQ can be implemented in practice by using Raptor codes HOl at the physical layer, and 
need no protocol overhead to communicate slot-by- slot rate allocation as in adaptive variable- 
rate coding. Hence, the proposed HARQ scheme is both easier to implement and performs 
significantly better than the conventional variable-rate coding scheme. Also, we hasten to say 
that our approach applies directly to a variety of possible configurations, including different 
MU-MIMO precoding schemes and network MIMO schemes with clusters of coordinated cells 
[|46l . In this paper we considered the case of linear ZFBF and no cell clustering for the sake 
of clarity of exposition. The approach can also be extended to the case of non-perfect CSIT, 
following [[TSl . Here we focused on perfect CSIT for its simplicity and in order to focus on the 
random nature of ICI as the fundamental source of uncertainty in a multi-cell environment. 
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Fig. 1. Qualitative plot of the mutual infoimation level-crossing process that determines the decoding events of the HARQ 
protocol. The jumps of the accumulated mutual information process correspond to slot times at which user {k, c) is active. 
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Fig. 2. Average-throughput, proportional fairness. 
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Fig. 3. Average-throughput, max-min fairness. 
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Fig. 4. Average rate vs. decoding delay with proportional fairness for two sample users. 
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Fig. 5. Average rate vs. decoding delay with max-min fairness for two sample users. 



